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Summary 



Concerns are expressed for the Monotonia Imbalance Bounding 
(MIB) property (lacus et al. 2011) and for MIB matching because 
i) the definition of the MIB property leads to inconsistencies and 
the nature of the imbalance measure is not clearly defined, ii) MIB 
property does not generalize Equal Percent Bias Reducing (EPBR) 
property, Hi) MIB matching does not provide statistical information 
available with EPBR matching. 

Imbalance Bounding (IB) matching is examined but the findings and the 
comments remain valid for MIB matching. Familiarity of the readers with 
lacus, King and Porro (2011, hereafter IKP 2011) and the notation therein is 
assumed. 

On the definition of the IB property 

We use the IB-Definition obtained from the authors in a recent communi- 
cation. 

IB-Definition: Let / be any measurable function and D(-, ■) any measure 
of imbalance that can be bounded by a scalar. Assume (a) fixed sizes of 
the random samples ut-, tlq, (b) fixed distributions of X, P^ for the treated 
population and Pq for the control population, (c) a fixed matching method is 
used. If for a given value of 6 we obtain matched samples of sizes rriT and mc 
such that 

D[f{X^^)J{Xma]<5, (1) 

then we have the property IB; Xmj., are, respectively, the matched-treated 
and matched-control data. 



^Appeared as online supplement to the JASA paper by lacus, King and Porro (2011) 
with response from the authors. 
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Since IB property ([T]) is dependent on a 5-value determined in advance 
(ex-ante), the following situations will occur: 

a) for fixed treatment and control populations and a statistician with ex- 
ante 6 = 6i the matching method has not the IB property, but for another 
statistician with ex-ante S = 62 > Si and 62 large enough the same matching 
method has the IB property. Consequently, the two statisticians will be in 
disagreement on whether the matching method has the IB property or not, 
leading to an inconsistency. Thus, the class of IB matching methods is not 
well defined. 

b) For readers inclined to justify the inconsistency in from the sub- 
jective choice of different 5-values by the two statisticians, consider a fixed 
matching method, one statistician and two sets of treatment and control pop- 
ulations with distributions Pt^ and Pd and bounds 6i, i = 1,2. This statis- 
tician may find that the matching method satisfies IB property ([1]) for the 
distributions and the bound {Pt^, Pc^, 61) but not for the distributions and 
the bound {Pt^, Pc2^^2)- Does the matching method have the IB property in 
this situation? This will hold if the IB definition is population dependent but 
it is not the case since, according to the authors, no assumptions are needed 
on the populations' distributions for IB property to hold (IKP 2011, p. 346, 
section 2.2, lines 2-4). 

Looking at ([1]) any graduate student in statistics would ask "What is the 
probability that ([1]) holds?" given that / is a measurable function not neces- 
sarily constant. If this probability is equal to 1, questions will arise concerning 
the applicability of the method for all populations' distributions, suggesting 
that IB-definition is population dependent. If this probability is less than 1, 
IB definition is data dependent and therefore, for a fixed 5- value, the matching 
method may have the IB property for one data set but this may not hold for 
a different data set from the same population. 

Note that in IB definition (IKP 2011, p. 347), D{x,y) denotes a dis- 
tance between x and y but in the examples following this definition D{x,y) = 
E{x — y) and D{x,y) = \x\ are not distances; E denotes expected value. In 
IB definition ([1]) "D is any measure of imbalance" but no precise definition 
of what this means is available. There are no guidelines for the choice of the 
(5- value and a natural approach for its selection presented below makes IB def- 
inition data dependent. 
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IB and EPBR matchings-Does IB matching generalize EPBR matching? 

Our main argument against the claim in IKP (2011) that IB property 
generahzes Rubin's EPBR property (Rubin 1976) is that IB loses the EPBR 
property of afiine invariance with respect to linear combination of means. In 
a recent communication the authors provided the arguments that follow, in 
order to show that IB property is "a mathematical generalization of EPBR 
property." Their motivation for the IB definition is EPBR definition 

/^T* - /Uc* = 7(/^T - /^c), < 7 < 1, (2) 

i.e. the expected value of the difference of matched samples means, /xt* — yUc* , 
is a proportion 7 of the expected value of the difference of random samples 
means, ~ /^c- For elements a:, y let D{x, y) = x — y and for a random vector 
A set f{A) = E{A); E{A) denotes the expected value of A. Then, EPBR 
property is rewritten in the IB-like notation 

D[f{A:^^)j{A:^^)] = s, (3) 

with 

'^rriT^ '^mc deuote matched sub-samples and /(A^i^), /(A'^c) denote the ex- 
pectations of the matched sample means. Finally, the equality sign in (|3]) is 
replaced by "<" and the authors' conclusion is that "In this way, we have 
shown that IB is a direct mathematical generalization of EPBR." However, 
E[A) is a functional of the cumulative distribution of A and this also holds 
for the expectations' differences in ([2]) but is not reflected in and the IB 
definition ([1]) which only involve measurable functions of the data. Thus, the 
authors' arguments do not show that IB property is mathematical generaliza- 
tion of EPBR property. 

Irrespective of the last sentence, using the authors' motivation we examine 
whether statistical information other than affine invariance is lost with IB 
matching methods. Going one step further from 5's definition in (jl]) we obtain 
from the EPBR property 

S = lifiT - f^c) = 7D[f{Xnr)J{Xnc)], (5) 

Xnj,,Xn(. are random samples. It may occur, for example, that a practi- 
tioner uses an IB matching method with (small) 5-value 10~^, but the value 
oi D[f{Xn^)J{X^^)] is 10-^ Equation ® suggests using D[f{Xn^)J{X^^)] 
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to determine an appropriate (5-value but this will introduce random sample 
dependence in the IB definition unless / is constant. 

Unlike the IB property, EPBR property ([2]) provides via 7 information on 
the improvement of expected matched means' difference compared to the ex- 
pected random means' difference. In the IB definition a subjective 5-value is 
used, it is not clear in IKP (2011) what this value should be and there is no 
comparison with the D-value obtained via / for random samples. Moreover, 
with the EPBR property both sides in ([2]) have the same sign. This informa- 
tion is also lost with a distance D in the IB definition. Thus, there is loss 
of statistical information when using IB matching methods instead of EPBR 
matching methods. 

EPBR property ([2]) is clearly moments' property and mild moment condi- 
tions are provided in Yatracos (2013) for EPBR property to hold for a class 
of matching methods, thus relaxing the criticism that EPBR holds only under 
restricted distributional assumptions (IKP 2011, p. 346). 

The concerns presented for IB matching methods hold also for MIB match- 
ing methods (IKP 2011, p. 347) for which ([1]) holds with data X^j-Itt), '^mdn) 
and upper bound 7/,d('?^") (instead of 6) depending on a tuning parameter vr; 
lf,D{') is monotonically increasing in vr. 
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